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TITLE: FAST BEAT COUNTER WITH STABILITY ENHANCEMENT 
BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to a system for computerized determination of rhythmic beat from 
5 a musical excerpt, which is particularly useful in music playback systems such as "disc jockey" 
(DJ) equipment. 

2. Discussion of the Related Art 

Advances in high performance state-of-the-art digital signal processors (DSPs) have led to 
ry much research into training machines to listen and respond in the same manner as human listeners 
W to music compositions. Beat counting has been an active research topic among engineering and 
y music societies. This interest derives from the fact that beat counting provides a basis for 
L automatic music transcription and adds dynamics to music playback systems such as DJ 

-sjb; 

S equipment. A good beat counting algorithm, upon which DSPs base their patterns, must be 
capable of extracting relevant beat information from the music and providing a digital output 

15 representing the beat which corresponds to that which would be perceived by a human musician. 

Human listeners have little problem feeling the beat of most music excerpts. Information, 
derived from the temporal changes of pitch and timber, words, and the presence of drumbeats, 
provides adequate cues easily discerned by the ears and brains of listeners. On the other hand, 
computers or DSPs cannot perceive such information without the application of complex 

20 processing techniques such as pitch extraction, speech recognition, and pattern matching. Even 

1 
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where these techniques can be implemented, they provide incomplete solutions. For example, 
pitch tracking is successful only on monophonic music; it fails otherwise. The same limitation 
exists for systems which track changes in timber and words. Also, drum beat tracking is 
ineffective with respect to music pieces having no drums. 
5 One improvement on the above systems is to treat all the above factors equally and to 

attempt to detect a consistent "change pattern" based on an assumption that most changes, which 
indicate the presence of beats, appear in music signals as onsets of energy modulation. With this 
m technique, the beat counting, usually a cognition problem, is primarily based on onset searching 
fil and pattern matching in signal processing systems. With regard to processing of acoustical 
M signals, a straightforward method of onset searching or detecting employs the "edge detection" 
y technique commonly used in image processing systems. However, with the necessary high 

U sampling rate and long beat period (on the order of a few hundred milliseconds), direct edge 

M 

f 3 detecting is very time consuming. A filter bank implementation for reducing the computational 
complexity has been proposed by E.D. Scheirer in his article "Tempo and Beat Analysis of 

15 Acoustic Musical Signals," J. Acoust. Soc. Am. 103, 588, 1998 (incorporated by reference herein 
in its entirety). This method utilizes several filters to split the signal into different subbands and 
applies down sampling to reduce the total number of points needed for computation. 
Disadvantages are that filtering is itself time consuming and the subsequent processes must be 
carried out repeatedly for each band. Therefore, only modest reductions in processing 

20 requirements are achieved. While it has been demonstrated that the entire Scheirer algorithm is 
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sufficiently fast to run within the computation time of, for example, a Digital Equipment 
Corporation Alpha 3000™, it is a tight fit. With greater functionality being demanded by the DJ 
market, a tight-fit real time algorithm is not adequate. An efficient beat counting algorithm should 
be capable of running in real time on a less powerful DSP, along with other tasks. 

Edge detection generates a train of pulses coinciding with the locations of the onsets in the 
original acoustic signal. Based on this pulse train, a beat counter operates to determine the 
frequency of the pulse occurrences. There has been much research addressing this issue from the 
point of view of psychology and digital signal processing. Among the published algorithms are 
the autocorrelation algorithm and the resonator phase-locking algorithm. 

The autocorrelation method is implied (although not directly used in beat counting) in an 
article by J.C. Brown, "Determination of the Meter of Musical Scores by Autocorrelation," J. 
Acoust. Soc. Am. 94, 1993 (incorporated by reference herein in its entirety). The concept 
underlying this method is the same as that used by a pitch extractor, except that the beat period 
is considered longer. The autocorrelation coefficients of the pulse train signal are calculated, and 
the lag associated with the greatest coefficient is considered the beat period. 

The resonator phase-locking method was first presented by E. Large, et al., "Resonance 
and the Perception of Musical Meter," Connection Science 6, 177, 1994 (incorporated by 
reference herein in its entirety). The concept underlying this technique derives from the 
Helmholtz resonators which have been used to determine the frequency of analog acoustic signals. 
The method passes the train of pulses coinciding with the onsets of energy modulation through 
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each resonator of a set of digital resonators with different resonant frequencies. The resonator 
having maximum energy output is detected, and the frequency of the pulse train is determined by 
the resonant frequency of this resonator. 

Both the autocorrelation and resonator phase-locking methods generate results whose 
5 accuracy depends on the parameter settings. A disadvantage of both methods is the computational 
complexity and cost. Moreover, none of the above methods has adequately addressed concerns 
with the stability of the beat counter when experiencing an abnormal rhythm change. In this 
f regard, the only proposed solution has been to slow down the responding time, while averaging 
ru the result over a long time interval. This proposal has not produced good results. As a result of 
W) these problems, the above methods have been very limited in application. 
J;j As noted above, music playback systems such as DJ equipment require good performance 

l n and low costs. The cost of an algorithm is determined by memory requirements and, more 
O importantly, computational complexity. As discussed above, "real time" is no longer a sufficient 
condition; because DJ audio equipment performs more than one function at a time (such as 
15 simultaneously performing beat counting and sound-effect-changing), a speed much faster than real 
time is needed. There is no foreseeable limit on how fast the algorithm should be. 

SUMMARY OF THE INVENTION 
It is an object of the present invention to provide a novel beat-counting algorithm with a 
high computation speed which is significantly faster than real time and which can be employed on 
20 such apparatus as DJ equipment, CD players and audio effect boxes and with automatic music 
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transcription software. 

It is another object of the present invention to provide a novel beat-counting system having 

the capability of reporting stabilized results. This feature is enabled by the present invention 

because of the fast speed of the algorithm which gives time for additional decision-making steps 
5 to be carried out before a BPM (beats per minute) decision is reported. 

It is yet another object of the present invention to provide a novel beat-counting system 

which has the capability of operating on an acoustical signal rather than a MIDI (musical 

instrument digital interface) signal. 
m The algorithm according to the present invention is summarized as follows. An onset 

ljyp searching/pattern matching structure is employed with an efficient and reliable group-summing 
^ method that is conducted as a preprocessing step to reduce the sample points. The beat frequency 

searching algorithm is simplified based on a novel analogy with the beat perception mechanism 
g of the human mind and ears. After a BPM is generated, a stability enhancement method is used 

to decide whether the BPM needs to be updated. 
1 5 The goal of the algorithm of the present invention is to provide a beat counter which can 

be mounted on a CD player or an effect box for displaying beat count in real time. The algorithm 

includes five basic steps: down sampling, group summing, onset detecting, beat counting, and 

stability enhancing. 

According to one aspect of the invention, there is provided a method of determining a 
20 rhythmic beat of a digital sound signal, comprising the steps of (a) down sampling the digital 

5 
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signal by a predetermined factor to produce a decimated signal comprising a plurality of first 
data points; (b) grouping the plurality of first data points into groups each comprising a 
predetermined number of the first data points of the decimated signal and summing absolute 
values of the data points in each of the groups to produce a group-summed signal comprising a 
5 plurality of second data points; (c) dividing the plurality of second data points of the onset peak 
train into a plurality of successive frames of uniform duration; (d) determining for each of the 
frames a threshold value and detecting, within each of the frames, peak profiles each 
?a * comprising successive ones of the second data points having values greater than the threshold 
m value; (e) detecting, within each of the peak profiles, a peak point having a greatest value 

i 

ID among the successive ones of the second data points; and (f) determining a match between (i) 
y„ the peak point and ones of the second data points located at least one of before and after the 
;U peak point and (ii) one of a plurality of unit data pulse sequences, having different periods, in 
?n accordance with an algorithm, wherein the rhythmic beat is determined to correspond to the 
,0 period of the one of the unit pulse sequences. 

1 5 The threshold value may be defined by a relation (A + M)/2, where A is the average of 

the values of all of the second data points within one of the frames and M is the maximum of the 
values of all of the second data points within the one of the frames. Step (f) can comprise (i) 
calculating a function 

Sum* (n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n) 

20 where, for the first one of the frames, x is a signal representing the onset peak train, i is a selected 
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peak point index, M is a peak point position, and n is a period of the unit pulse sequences, where 
n ranges from a first integer number to a second integer number, (ii) calculating Sum(n) = 
Si Sum^n), and (iii) determining a value of n=N resulting in a greatest sum Sum(n) = 
Si Sum i(n), wherein the match is determined to exist with the one of the unit pulse sequences 
5 having a pulse period equal to N, and the rhythmic beat is determined to correspond to period N. 
The method may further comprise a check frame decision step (g) comprising: (i) with respect 
to a second frame of the plurality of successive frames which immediately succeeds the first one 
? ^ of the frames, performing a check frame decision processing by calculating a function Sunii (n) = 
i\t x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n), where, for the second frame, x is a 
94) signal representing the onset peak train, i is a selected peak point index, M is a peak point 
'J t position, and n is a period of the unit pulse sequences, where n ranges from n = N»Lton = 
'U N + L, where L is an integer number which is less that the difference between the first and second 
p integer numbers, calculating Sum(n) = Sum^n) and determining whether N yields a peak in 
J Sum(n) for the check frame processing of the second frame; (ii) if step (g)(i) determines that N 
15 yields the peak in Sum(n) for the check frame processing of the second frame, the rhythmic beat 
for the first frame and for the second frame is determined to correspond to period N and a third 
frame immediately succeeding the second frame is processed in accordance with step (g)(i), and 
(iii) if step (g)(i) determines that N does not yield the peak in Sum(n), the rhythmic beat for the 
second frame is determined to correspond to period N and the third frame is processed in 
20 accordance with step (g). 

7 
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According to another aspect of the invention, there is provided an apparatus for 
determining a rhythmic beat of a digital sound signal, the apparatus comprising (a) decimation 
means for down sampling the digital signal by a predetermined factor to produce a decimated 
signal comprising a plurality of first data points; (b) group summation means for grouping the 
5 plurality of first data points into groups each comprising a predetermined number of the first data 
points of the decimated signal and summing absolute values of the data points in each of the groups 
to produce a group-summed signal comprising a plurality of second data points; (c) means for 
dividing the plurality of second data points of the onset peak train into a plurality of successive 
r?i frames of uniform duration; (d) determination means for determining for each of the frames a 
Ijyp threshold value and for detecting, within each of the frames, peak profiles each comprising 
% 4 successive ones of the second data points having values greater than the threshold value; (e) 
detection means for detecting, within each of the peak profiles, a peak point having a greatest 

Q 

S value among the successive ones of the second data points; and (f) match detection means for 
^ determining a match between (i) the peak point and ones of the second data points located at least 
15 one of before and after the peak point and (ii) one of a plurality of unit data pulse sequences, 
having different periods, in accordance with an algorithm, wherein the rhythmic beat is determined 
to correspond to the period of the one of the unit pulse sequences. The apparatus of the invention 
can include the same refinements described above with respect to the method of the present 
invention. 

20 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram of an illustrative embodiment of a beat counting apparatus of the 
present invention. 

Fig. 2(a) shows an original acoustic signal. 
5 Fig. 2(b) shows the signal of Fig. 2(a) after down sampling and group summing. 

Fig. 2(c) shows the signal of Fig. 2(b) after smoothing. 
Fig. 2(d) shows the signal of Fig. 2(c) after differentiating, 
p Fig. 3 shows an onset peak train derived by processing the signal of Fig. 2(d). 

[U Figs. 4(a) and 4(c) shows examples of unit pulse sequences for comparison with the onset 

ID peak train shown in Fig. 4(b). 

> j Fig. 5 shows a Sum(n) function of the onset peak train frame of Fig. 4(b). 

0 Fig. 6(a) shows results of a BPM report without employing the stability enhancement 

: ^ method of the present invention. 

;. ?% 

Fig. 6(b) shows results of a BPM report while employing the stability enhancement method 

"H«? 

1 5 of the present invention. 

Fig. 7 shows BPM values for a two-minute sound file. 

Fig. 8(a) is a schematic diagram showing three successive frames of an onset peak train, 

and 

Fig. 8(b) is a flow chart which illustrates the check-frame decision technique of the present 
20 invention applied to the three successive frames of Fig. 8(a). 

9 
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Fig. 9 is a flow chart of the beat counting system with stability enhancement according to 
the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Fig. 1 is a block diagram of a beat counting apparatus of the present invention. The 
following provides an overview of the Fig. 1 apparatus; additional details will be provided in 
subsequent sections hereinbelow. In Fig. 1, a digitized acoustical signal comprising a sequence 
of digital data points or samples is input on line 110 to down-sampling unit 101 which down- 
samples the input digital signal by a factor of, for example, ten and provides a decimated signal 
on line 111. Group-summing unit 103 groups the data points of the decimated signal into groups 
of 30, for example, and forms a group sum of the absolute values of every 30 data points of the 
decimated signal and outputs the group-summed signal on line 113. Onset detecting unit 105 
employs a smooth-and-differentiate processor and detects the onset peaks of energy modulation 
in the group-summed signal on line 113 and generates on line 115 a train of pulses, hereinafter 
called the onset peak train, which coincides with the onset peaks. The onset peak train is 
illustrated, for example, in Fig. 2(d) and in Fig. 3. Beat-counting unit 107 performs a pulse- 
matching process by comparing, in accordance with an algorithm described in detail below, the 
onset peak train on line 115 with a set of unit pulse sequences of different periods and determines 
the one of the unit pulse sequences that most closely matches the period of the onset peak train. 
From this period, the beats per minute (BPM) are calculated, and an output representing the BPM 
is provided on line 117. Stability enhancement unit 109 employs a check-frame decision making 
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process on the BPM reported on line 117 and provides a stabilized BPM report on line 119. 

A detailed discussion of the components of the Fig. 1 apparatus will now be provided. 
1. Down-sampling unit 101 and group-summing unit 103 

Digital audio signals are usually sampled at 44.1 kHz. Direct processing of the signals would 

5 require tremendous computational power from the processor. However, with regard to beat 
perception, a large portion of the data carries unimportant information. Accordingly, retaining 
all of the details of the waveform is unnecessary. This is especially true when the signal will later 
be smoothed. The present invention employs two steps in reducing the data redundancy. First, 
the original signal is down sampled by a factor of ten, and second, every 30 data points are 

P summed. These two steps effectively reduce the sampling rate to 147 Hz, i.e., by a factor of 300, 
and greatly reduce the computational load of the DSP. The justification for this is described 

^ below. 

A major concern with regard to down sampling of a signal involves aliasing. However, 
§ the present invention recognizes that aliasing is not a real issue when there is no need to rely on 
1 5 the spectrum of the signal. It is the envelope of the waveform that matters for an onset detector. 
As long as the sampling rate can preserve the envelope and onsets of a waveform, it should be 
acceptable. Based on the assumption that the maximum beats per minute (BPM) are 180, which 
corresponds to three beats per second, a sampling rate of 147 Hz should suffice. However, 
directly down sampling the signal to 147 Hz poses a threat regarding the precision. First, some 
20 of the onsets might disappear with the 299 data points that are neglected. Secondly, the coarse 
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temporal resolution of the signal waveform would degrade the performance of the onset detector. 
In order to tackle these problems, the present invention employs the aforementioned "group 
summing" method, which involves, rather than discarding data points, summing them up. In other 
words, after the 10:1 decimation of the original signal, the points are grouped into groups of 30, 
5 and each group is represented by the scaled sum of the absolute values of their members. This 
procedure turns out to be more than what it first seems. Because of the fact that group-summing 
performs data smoothing and, at the same time, preserves the peaks with width of the group 
dimension, it not only reduces sample points but also assists in onset detection. This can be seen 
ry from Fig. 2(b) where the onsets of the original signal have been redefined as prominent peaks after 
EU) group summing. With this concise version of the signal (i.e., achieved after decimation and 
y group-summing), the following calculation can be done in a much more efficient way than is the 
!U case with many other beat counter algorithms. 
12 2. Onset detection unit 105 

rll For certain strong-beat music pieces, the peaks formed by the down-sampling and group- 

15 summing units 101 and 103 described above provide sufficient information for beat counting 
without the need of onset detection. However, to ensure better quality and broader application, 
an onset detector 105 is incorporated into the beat-counting system of the present invention. This 
onset detector 105 is a smooth-and-differentiate processor which in itself is known to those skilled 
in the art and can be easily found in the existing literature (for example "Two-Dimensional Signal 
20 and Image Processing" by Jae S. Lim PTR PRENTICE HALL). The specific computation adopted 
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in the algorithm of the present invention will now be briefly described. First, the group-summed 
signal is smoothed by a low pass filter which is 100 milliseconds long with a cutoff frequency at 
about 20 Hz (the filter is 7-tab when the sampling rate is 147 Hz). Then, the differentiation is 
performed as follows. The difference between every other sample point is calculated to extract 
5 the sharp transitions of the smoothed signal The reason for taking the difference of every other 
point is to extract the sharp transitions of the smoothed signal and to make the peaks stand out 
more clearly by avoiding some fine fluctuation of the smoothed signal. Alternatively, since only 
^ half of the data in the smoothed signal is needed, the smoothed signal can be calculated for every 
; y other point while taking the straight difference. The second method saves the DSP half of the 
10 effort of computing the convolution between the signal and the filter. Finally, a rectifier is used 
^ to set to zero the data points whose values fall below zero. This is done under the assumption that 
1^ onsets only concern the rising of the signal amplitude not the opposite. The results are shown in 
P the graphs of Figs. 2(c) and (d). The onset peaks of the onset peak train of Fig. 2(d), which 
\Q suggest the beat locations, are then used for beat counting in beat counting unit 107 of Fig. 1. 

X[; 

15 3. Beat counting unit 107 

Beat counting unit 107 receives the onset peak train from onset peak detecting unit 105 and 
performs a pulse matching process to estimate the BPM as described below. The beat counting 
algorithm of the present invention, when compared with the resonator phase-locking technique, 
has a different approaching concept and different implementation. The theory of phase-locking 

20 is to liken the human beat perception system to a resonator, which, when properly tuned, can 
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identify the frequency of a noise-affected periodic signal. A problem with this approach is that 
the resonator needs to process the whole input signal and monitor every single output data for 
some period in order to determine the waveform pattern and come up with a frequency number. 
This might be the way humans perceive pitch, but it is not exactly the way they achieve beat 
5 perception. It would be more natural to say that humans perceive rhythm by first locating an 
onset, looking back in their memory for recently perceived onsets, and then studying the regularity 
of the occurrences of the onsets. With regard to beat perception, the information between beats 
does not really contribute. With this in mind, the present invention employs a novel algorithm 
m which ignores most of the unnecessary processes. This algorithm, as opposed to the 
M autocorrelation and the resonator phase-locking algorithms which operate on every sample, 
N processes only those data points which lie at the top of certain pulse peaks. In the present 
U invention, these points are denominated "peak points" (Fig. 3). The techniques of the present 
H invention for searching and pulse matching are implemented as described below. 

The onset peak train generated by the onset detector 105 is segmented into frames of about 
1 5 two seconds long. A peak profile is defined by those successive points inside a frame with values 
higher than a threshold T calculated as: 

T= A+ (M- A)/2 = (A+ M)/2 
where A and M are, respectively, the average and the maximum of all data points within an 
onset peak train frame. In Fig. 3, the threshold T is indicated by the dashed line, and the peak 
20 points are indicated by the asterisks. The peak point is the data point with the greatest value in 
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the peak profile. The pulse matching process is as follows. First, it is assumed that the peak 
point is at a beat position, and the onset peak train is compared with a set of unit pulse 
sequences of different periods. Fig. 4(b) shows an onset peak train, and Figs. 4(a) and 4(b) 
show examples of unit pulse sequences. The period of the unit pulse sequence best matching 
the period of the onset peak train is selected as a candidate for the onset peak train period. The 
determination of the match is made mathematically as described below. 

A function Sum^n) is calculated by adding the values of ten onset peak train data points 
matched by the unit pulses before and/or after the peak point. A match is defined as a coincidence 
in time. Sun^ (n) is expressed as: 

Sum^n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n) (1) 
where x is the onset peak train signal, i is the selected peak point index, M is the peak point 
position, and n is the unit pulse period, which ranges from 20 to 80 (which corresponds to BPM 
values 55 to 180). The inclusion of x(M) in the sum means that all unit pulse sequences must have 
at least one pulse right at the peak point i. If there exists a beat pattern matching a unit pulse 
sequence with period N, Sum^n) would show a maximum at unit pulse period n=N. Since there 
is certainly no guarantee that peak point i is really "on the beat," it is not sufficient merely to 
maximize Sum^n). Accordingly, the present invention includes the following further processing 
steps. Sum^n) is calculated for all peak points in the frame, and the values are accumulated to 
yield another function Sum(n), as defined in equation (2): 

Sum(n) = SjSum^n) (2) 
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The value N, which results in the greatest Sum(n), is determined to be the beat period in terms of 
the points of the onset peak train. 

It should be noted that no matter how large n is, ten data points are always summed, 
expecting the beat pattern to repeat itself ten times. Also, when carrying out equation (1), a 
5 forward sum is performed first, i.e., adding up the data after M, until the frame boundary is 
reached, then a backward sum is performed, until ten data points have been added. The memory 
size, as a result, should be sufficiently large to store data points of previous frames for all n's. The 
amount of the memory buffer used in the process varies with the beat period, ranging from 200 
frj (20x10) to 800 (80x10) points. This is quite natural because it resembles the way the human 
U4D perception network works in that a longer time is required to set up the beat feeling for slow-paced 
y music than for fast-paced music. It should be noted also that, as shown in Fig. 3, only four peak 
!U points are selected out of 150 points in the frame. If the logic of autocorrelation or resonator 
n phase locking were followed, 30 times more computation would be needed for the task. Although 
\Jj Fig. 3 shows only one particular example, it is adequate to show how the present invention saves 
15 computation time. Moreover, due to the group-summing technique of the present invention, the 
memory size is comparatively smaller than what would be needed using a prior art technique. 

Fig. 5 demonstrates one of the Sum(n) functions of the onset peak train frame in Fig. 3 and 
Fig. 4(b). Here, the best period (N=44) is successfully estimated by the highest peak. This 
period is related to the actual beat period by just a time factor resulting from sample reduction. 
20 After the beat period is determined, BPM can be calculated accordingly. 
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4. Stability Enhancement unit 109 

Stability enhancing unit 109 receives the BPM output from beat counting unit 107 and 
employs a check-frame decision making procedure to yield a stabilized BPM output on line 119. 
The beat counting system described above updates the values of BPM every frame, which is two 
5 seconds based on the value of the parameters chosen above. In each frame, the beat period is 
determined by the value of n which maximizes Sum(n) in equation (2). This is based on the theory 
that the period best coinciding with the onset peaks is the time duration of a quarter note. One 
possible scenario is that, for some time interval, the most frequently occurring note undergoes a 
?ji§ change from a quarter note to another note, for example, an eighth note. As a result, the 

ii Tzr 
i-S ; * !j 
I'M 

ikD calculated period differs by, for example, a factor of two. If the change occurs over a short time 
s 4 period, the human's sense of beat will not be altered because of the integer-ratio-relationship of 

ru 

^ the two note values. However, the computerized beat counter would report a very different BPM 

} S value. This phenomenon, along with the actual presence of some short-term abnormal change of 
the beat pattern, results in some instability of the BPM reporting system. In order to improve the 

15 robustness of the beat counter, the present invention employs a method which allows the short- 
term fluctuation to be avoided without compromising the accuracy of beat calculation. This 
method will now be described in detail with reference to Figs. 8(a) and 8(b). 

First, the BPM value for a first frame 1 of a music piece is calculated using the novel beat- 
counting algorithm described in the previous sections. This BPM is assumed to be reported based 

20 on the duration of a quarter note just found. This frame is denominated a full-processed frame for 
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the reason that the beat period, N, is determined by evaluating Sum(n) among all possible values 
of n ranging from 20 to 80 in the illustrative process described above, thus resulting in Sum(N) 
being a global maximum. As for the next frame, i.e., frame 2 in Fig. 8(a), which is tentatively 
denominated a check-frame, the process is simplified. Here, Sum(n) is evaluated only between 
5 n = N-10 and n = N+ 10. In other words, N is the beat period determined for frame 1; if, by 
way of example, N=44, Sum(n) for frame 2 would be evaluated only between n=34 and n=54, 
rather than n=20 and n=80 as with a full-processed frame. The purpose is to check if N still 
m yields a peak in Sum(n) locally. The idea is that, even when the eighth note dominates in the 
ry current frame, the quarter note should still retain preference among its neighbors and present itself 
ttD as a local maximum in Sum(n). As long as Sum(N) is a local maximum, BPM of the previous 

if si 

frame is reported for the current check-frame, and the next frame, i.e., frame 3 in Fig. 8(a), 
J* would still be a check-frame. If, on the other hand, Sum(N) is not a local maximum, BPM of the 
p previous frame is reported for frame 2, but the next frame, i.e., frame 3 in Fig. 8(a), is set as a 
^0 full-processed frame. It should be noted that BPM is only updated in a full-processed frame and 
15 never in a check-frame. If Sum(N) is not a maximum, this suggests that a dramatic change of the 
rhythm and a new BPM should be determined without the bounds of the previous results. If the 
change is short term compared with the frame size, the old BPM will report, and there is a greater 
confidence level in confirming that the pace of the music does change. 

Fig. 8(b) is a flow chart illustrating the check-frame decision technique described above. 
20 Step 800 initiates processing of the "next" frame which, as it is being processed, is denominated 
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the current frame. In step 801, the current frame (frame 1) is handled as a full-processed frame, 
and N for this frame is determined by making Sum(N) a global maximum. The BPM for this 
frame is updated in step 803 corresponding to beat period N. In step 805, processing of the next 
successive frame (frame 2), which is a check-frame, is begun, and in step 807, a determination 
is made as to whether Sum(N) is a local maximum for this frame. Regardless of whether the 
answer is yes or no, N is assigned to this frame (frame 2) since it is a check-frame, and the BPM 
is not updated for this frame. If step 807 determines that Sum(N) is a local maximum for this 
frame, the next frame (frame 3) is also treated as a check-frame. If step 807 determines that 
Sum(N) is not a local maximum, the next frame (frame 3) will be handled as a full-processed 
frame by proceeding to step 800. Steps 801-809 would then be carried out with respect to this 
frame (frame 3). It will be apparent that all frames of the onset peak train may be processed in 
this manner. 

As can be seen, the decision making process employing the check-frame adds error 
resilience to the beat counter apparatus of the present invention. The only cost is the speed of the 
response to actual beat changes. As is apparent, the method must wait two frames to report a new 
value of BPM. With a frame two seconds long, it would seem that there will be a four seconds 
delay in response to the change. However, in actuality, no human being can foresee the beat 
change right at its beginning. Human beat perception has delays, too. Humans must wait to 
receive a couple of new beats to discern whether the beat pace has changed or not. The delay 
depends on the beat period which could be as long as two seconds if BPM is 60. As a result, the 
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delay is not a problem. Moreover, even with regard to this "four seconds," there is a way to get 
around it when the algorithm is used on a CD player which has speed 2X or higher. With the high 
speed, the algorithm can actually "foresee" the future by utilizing the buffer; in other words, it can 
be fed with the data of the frame after the frame to which the DJ is currently listening. The actual 
5 situation would be such that, when the DJ is listening to a check-frame which suggests a new 
BPM, the algorithm is preparing to update the value before the DJ finishes that check frame. The 
delay can thus be cut to less than two seconds. 

Figs. 6(a) and (b) show the BPM values of a rock song {Semi-Charmed Life by Third Eye 
ro Blind) reported by the algorithm of the present invention with and without stability enhancement. 

Vi 

W It is apparent from Figs. 6(a) and 6(b) that the check frame decision making greatly stabilizes the 
system. The BPM values reported without stability enhancement jump mostly among values 

JU having ratios close to those of two small integers, such as 2/3. This is due to the variability of 

O music progressing rather than a real change of rhythm. A good beat counter should not be 
confused by this phenomenon. 

15 It should be noted that, by stabilizing the BPM reporting system, it is not blinded from 

detecting the real change. In fact, the system is capable of responding to a tempo change. Fig. 
7 shows the BPM values for a two-minute sound file generated by manually pasting one sound 
sample to another using a waveform editor. The sound file has a sudden tempo change at about 
one minute into the file, estimated between the 27 th and 28 th frames in the graph. As can be seen, 

20 the system started its response at the 29 th value, although it seems to need a transition time before 
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the new beat count is settled. This transition time is partly due to the requirement that ten data 
points should be added for Sum(n) and partly due to the imperfect connection between the two 
independent sound points. For the former, the transition time depends on the new tempo and 
should be shorter when the value is higher than 60 beats per second, the value for the second half 
in Fig. 7. As for the latter, it should not be a concern because it does not happen in a well- 
behaved music piece. 

The performance of the computational speed is dramatic. It takes only eight seconds to 
process a 4.5-minute song. It should be noted that all the values of the parameters are changeable. 
For example, the parameters can be set so as to yield a beat counter with greater computational 
complexity yet shorter response time. However, with reasonable change, the fast speed is 
guaranteed, allowing simultaneous operations of beat-counting with other sound effects, and this 
is exactly what the DJ market needs. 

Fig. 9 is a flow chart illustrating the overall system of the present invention. In Step 901, 
the input digital signal is down sampled by a predetermined factor (for example, ten) to produce 
a decimated signal comprising a plurality of first data points. In Step 902, the plurality of first 
data points are grouped into groups each of which comprise a predetermined number of the first 
data points (for example, 30) of the decimated signal and the absolute values of the data points in 
each of the groups are summed to produce a group-summed signal comprising a plurality of 
second data points. Step 903 includes deriving from the group-summed signal an onset peak train 
comprising a plurality of third data points in accordance with an algorithm which involves either 
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setting the third data points to be identical to the second data points or processing the second data 
points in accordance with a smooth-and-differentiate algorithm to obtain the third data points. Step 
904 includes dividing the plurality of third data points of the onset peak train into a plurality of 
frames of uniform duration, and Step 905 includes detecting, within each of the frames, peak 
profiles each comprising successive ones of the third data points having values greater than a 
predetermined threshold. Step 906 includes detecting, within each of the peak profiles of each of 
the frames, a peak point having a greatest value among the successive ones of the third data points. 
In Step 907, a match is determined between the peak point and one of a plurality of unit data 
pulse sequences, having different periods, in accordance with a predetermined criterion, wherein 
the rhythmic beat is determined corresponding to the period of the one of the unit pulse sequences. 
Step 908 includes performing a check frame decision making process as set forth in Fig. 8(b) in 
order to provide a stabilized output of the RPM. 

It will be apparent to those of ordinary skill in the art that all the values of the parameters 
used in the detailed description of the present invention set forth herein may be modified to meet 
the requirements of any specific implementation. Moreover, although the present invention has 
been fully described by way of examples with reference to the accompanying drawings, it should 
be understood that numerous variations, modifications and substitutions, as well as rearrangements 
and combinations, of the preceding embodiments will be apparent to those skilled in the art 
without departing from the novel spirit and scope of this invention. 
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/is claimed is: 
A method of determining a rhythmic beat of a digital sound signal, said method 

2 comprising: 

3 (a) down sampling the digital signal by a predetermined factor to produce a decimated 

4 signal comprising a plurality of first data points; 

5 (b) grouping said plurality of first data points into groups each comprising a perdetermined 

6 number of said first data points of said decimated signal and summing absolute values of said data 

7 points in each of said groups to produce a group-summed signal comprising a plurality of second 
data points; 

tl (c) dividing said plurality of second data points of said onset peak train into a plurality of 

1Q successive frames of uniform duration; 

II (d) detennining for each of said frames a threshold value and detecting, within each of said 

fiZ frames, peak profiles each comprising successive ones of said second data points having values 
1 1 greater than said threshold value; 

14 (e) detecting, within each of said peak profiles, a peak point having a greatest value among 

15 said successive ones of said second data points; and 

16 (f) determining a match between (i) said peak point and ones of said second data points 

1 7 located at least one of before and after said peak point and (ii) one of a plurality of unit data pulse 

18 sequences, having different periods, in accordance with an algorithm, wherein said rhythmic beat 

19 is determined to correspond to the period of said one of said unit pulse sequences. 



23 



PATENTS 
JEL30683 



1 2. A method according to claim 1, further comprising, prior to step (c), processing said 

2 second data points in accordance with a smooth-and-differentiate algorithm. 

13. A method according to claim 2, wherein said smooth-and-differentiate algorithm comprises 

2 a rectification step including setting to zero all of said second data points having values less than 

3 zero, 

% 4. A method according to claim 1 , wherein said threshold value is defined by a relation (A + 

i u 

hk M)/2, where A is the average of the values of all of said second data points within one of said frames 

%B and M is the maximum of the values of all of said second data points within said one of said frames. 

'SSS 

Si 5. A method according to claim 1 , wherein step (f) comprises calculating a function 

y 

Ji Sum, (n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n) 

3 where, for said first one of said frames, x is a signal representing the onset peak train, i is a 

4 selected peak point index, M is a peak point position, and n is a period of the unit pulse 

5 sequences, where n ranges from a first integer number to a second integer number, (ii) 

6 calculating Sum(n) = Sj Sum^n), and (iii) determining a value of n=N resulting in a greatest 

7 Sum(n) - S t Sum^n), wherein said match is determined to exist with said one of said unit 

8 pulse sequences having a pulse period equal to N, and said rhythmic beat is determined to 

24 



PATENTS 
JEL30683 



9 correspond to period N. 



1 6. A method according to claim 5, further comprising a check frame decision step (g) 

2 comprising: 

3 (i) with respect to a second frame of said plurality of successive frames which immediately 

4 succeeds said first one of said frames, performing a check frame decision processing by calculating 

5 a function Sum^n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n), where, for said 
S J> second frame, x is a signal representing the onset peak train, i is a selected peak point index, M 
JH7 is a peak point position, and n is a period of the unit pulse sequences, where n ranges from n = 
UjB N - L to n = N + L, where L is an integer which is less than a difference between said first and 
s ^ second integers, calculating Sum(n) = 2, Sum^n) and determining whether N yields a peak in 

Sum(n) for said check frame processing of said second frame; 

Xl (ii) if step (g)(i) determines that N yields said peak in Sum(n) for said check frame 

lm processing of said second frame, said rhythmic beat for said first frame and for said second frame 

13 is determined to correspond to period N and a third frame immediately succeeding said second 

14 frame is processed in accordance with step (g)(i); and 

15 (iii) if step (g)(i) determines that N does not yield said peak in Sum(n), said rhythmic beat 

16 for said second frame is determined to correspond to period N and a third frame immediately 

17 succeeding said second frame is processed in accordance with step (f). 
1 7. A method according to claim 4, wherein step (f) comprises calculating a function 
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2 Sumj (n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n) 

3 where, for said first one of said frames, x is a signal representing the onset peak train, i is a 

4 selected peak point index, M is a peak point position, and n is a period of the unit pulse 

5 sequences, where n ranges from a first integer number to a second integer number, (ii) 

6 calculating Sum(n) = Sj Sum^n), and (iii) determining a value of n=N resulting in a greatest 

7 Sum(n) = Ej Sum^n), wherein said match is determined to exist with said one of said unit 

8 pulse sequences having a pulse period equal to N, and said rhythmic beat is determined to 
J correspond to period N. 

ij 8. A method according to claim 7, further comprising a check frame decision step (g) 

'1 comprising: 

% (i) with respect to a second frame of said plurality of successive frames which immediately 

M succeeds said first one of said frames, performing a check frame decision processing by calculating 

'*§ a function Sum^n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n), where, for said 

6 second frame, x is a signal representing the onset peak train, i is a selected peak point index, M 

7 is a peak point position, and n is a period of the unit pulse sequences, where n ranges from n = 

8 N-Lton = N + L, where L is an integer which is less than a difference between said first and 

9 second integers, calculating Sum(n) = 2, Sum^n) and determining whether N yields a peak in 

10 Sum(n) for said check frame processing of said second frame; 

11 (ii) if step (g)(i) determines that N yields said peak in Sum(n) for said check frame 
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12 processing of said second frame, said rhythmic beat for said first frame and for said second frame 

13 is determined to correspond to period N and a third frame immediately succeeding said second 

14 frame is processed in accordance with step (g)(i); and 

1 5 (iii) if step (g)(i) determines mat N does not yield said peak in Sum(n), said rhythmic beat 

16 for said second frame is determined to correspond to period N and a third frame immediately 

17 succeeding said second frame is processed in accordance with step (f). 

18 



??| /9. An apparatus for determining a rhythmic beat of a digital sound signal, said apparatus 

i / 

IM comprising: 

3 (a) decimation means for down sampling the digital signal by a predetermined factor to 

J4 produce a decimated signal comprising a plurality of first data points; 

"I: sew 

(b) group summation means for grouping said plurality of first data points into groups each 
comprising a predetermined number of said first data points of said decimated signal and summing 

7 absolute values of said data points in each of said groups to produce a group-summed signal 

8 comprising a plurality of second data points; 

9 (c) means for dividing said plurality of second data points of said onset peak train into a 

10 plurality of successive frames of uniform duration; 

1 1 (d) determination means for determining for each of said frames a threshold value and for 

12 detecting, within each of said frames, peak profiles each comprising successive ones of said second 
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13 data points having values greater than said threshold value; 

14 (e) detection means for detecting, within each of said peak profiles, a peak point having 

15 a greatest value among said successive ones of said second data points; and 

16 (f) match detection means for determining a match between (i) said peak point and ones of 

17 said second data points located at least one of before and after said peak point and (ii) one of a 

18 plurality of unit data pulse sequences, having different periods, in accordance with an algorithm, 

19 wherein said rhythmic beat is determined to correspond to the period of said one of said unit pulse 

20 sequences. 

1 J 10. An apparatus according to claim 9, further comprising means for processing said second 

% £ data points in accordance with a smooth-and-differentiate algorithm prior to said second data 

;3 points being divided into said frames. 

; r| 11. An apparatus according to claim 9, wherein said means for processing in accordance with 

2 said smooth-and-differentiate algorithm comprises a rectification step including setting to zero all 

3 of said second data points having values less than zero. 

1 12. An apparatus according to claim 9, wherein said threshold value is defined by a relation (A 

2 + M)/2, where A is the average of the values of all of said second data points within one of said 

3 frames and M is the maximum of the values of all of said second data points within said one of said 
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4 frames. 



1 13. An apparatus according to claim 9, wherein said match detection means comprises means for 

2 performing a full processing operation comprising calculating a function 

3 Sum, (n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n) 

4 where, for said first one of said frames, x is a signal representing the onset peak train, i is a 

5 selected peak point index, M is a peak point position, and n is a period of the unit pulse 

6 sequences, where n ranges from a first integer number to a second integer number, (ii) 

jl calculating Sum(n) = 2j Sum^n), and (iii) determining a value of n=N resulting in a greatest 

|| Sum(n) = Si Sum^n), wherein said match is determined to exist with said one of said unit 

';;Sj pulse sequences having a pulse period equal to N, and said rhythmic beat is determined to 

|Q correspond to period N. 

=Jj 14. An apparatus according to claim 13, further comprising (g) a check frame decision means for: 

2 (i) with respect to a second frame of said plurality of successive frames which immediately 

3 succeeds said first one of said frames, performing a check frame decision processing by calculating 

4 a function Sum^n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n), where, for said 

5 second frame, x is a signal representing the onset peak train, i is a selected peak point index, M 

6 is a peak point position, and n is a period of the unit pulse sequences, where n ranges from n = 

7 N-Lton = N + L, where L is an integer which is less than a difference between said first and 
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8 second integers, calculating Sum(n) = Ej Sum^n) and determining whether N yields a peak in 

9 Sum(n) for said check frame processing of said second frame; 

10 (ii) if operation (g)(i) determines that N yields said peak in Sum(n) for said check frame 

1 1 processing of said second frame, said rhythmic beat for said first frame and for said second frame 

12 is determined to correspond to period N and a third frame immediately succeeding said second 

13 frame is processed in accordance with operation (g)(i); and 

14 (iii) if operation (g)(i) determines that N does not yield said peak in Sum(n), said rhythmic 
JL£ beat for said second frame is determined to correspond to period N and said third frame is 
rjjS processed in accordance with said full processing operation. 

w 

"'-Ji 

I J. 15. An apparatus according to claim 12, wherein said match detection means comprises means 

'fio. for performing a full processing operation comprising calculating a function 

m Sunij (n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n) 

4 where, for said first one of said frames, x is a signal representing the onset peak train, i is a 

5 selected peak point index, M is a peak point position, and n is a period of the unit pulse 

6 sequences, where n ranges from a first integer number to a second integer number, (ii) 

7 calculating Sum(n) = S s Sum^n), and (iii) determining a value of n=N resulting in a greatest 

8 Sum(n) = Ej Sum^n), wherein said match is determined to exist with said one of said unit 

9 pulse sequences having a pulse period equal to N, and said rhythmic beat is determined to 
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10 correspond to period N. 

1 16. An apparatus according to claim 15, further comprising (g) a check frame decision means for: 

2 (i) with respect to a second frame of said plurality of successive frames which immediately 

3 succeeds said first one of said frames, performing a check frame decision processing by calculating 

4 a function Sum^n) = x(M) + x(M+n) + x(M+2n) + ... + x(M-n) + x(M-2n), where, for said 

5 second frame, x is a signal representing the onset peak train, i is a selected peak point index, M 
S J> is a peak point position, and n is a period of the unit pulse sequences, where n ranges from n - 
jrf? N-Lton = N + L, where L is an integer which is less than a difference between said first and 
itjS second integers, calculating Sum(n) = Z; Sum^n) and determining whether N yields a peak in 
" 5 Sum(n) for said check frame processing of said second frame; 

3Lp (ii) if operation (g)(i) determines that N yields said peak in Sum(n) for said check frame 

'M processing of said second frame, said rhythmic beat for said first frame and for said second frame 

JB2 is determined to correspond to period N and a third frame immediately succeeding said second 

13 frame is processed in accordance with operation (g)(i), and 

14 (iii) if operation (g)(i) determines that N does not yield said peak in Sum(n), said rhythmic 

15 beat for said one of said second frame is determined to correspond to period N and said third 

16 frame is processed in accordance with said fiill processing operation. 
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ABSTRACT OF THE DISCLOSURE 
A real time, multi-function beat counting system used in machine perception of musical rhythms 
employs a high speed stable algorithm including down sampling and group summing of the original 
signal, pulse matching on peak points, and check-frame decision making. The down sampled and 
group summed signal is utilized to derive an onset peak train formed of a series of data points. The 
onset peak train is divided into frames, and a threshold value is determined for each frame. In each 
frame, peak profiles are determined, each comprising successive data points within the frame having 
values greater than the threshold value. Within each peak profile, a peak point is identified. An 
algorithm is employed to compare the onset peak train with a plurality of unit data pulse sequences 
having different periods, and a match is determined between the onset peak train and the closest one 
of the unit data pulse sequences to identify the period of the rhythm. 
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APPLICATION FOR UNITED STATES PATENT 
Declaration for Patent Application 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought on 



the invention entitled: FAST BEAT COUNTER WITH STABILITY ENHANCEMENT 
the specification of which 2 (file no. JEL 30683 

30 



(check at least one) 



is attached hereto 

was filed on 

and was amended on 



. as (5) U.S. Application Serial No.. 



(if applicable) 



Use this portion 
only if you are 
entering the VS. 
National phase 
based on a PCX 
International 
Application 
designating the 
U.S. 



8 

9 

10 
11 



was filed as PCT international application 
Number 



and was amended under PCT Article(s) 19 and/or 34 

on 

priority date claimed in PCT International Application 



_(if applicable). 



(Country) 



(Number) 



(Day/Month/Year Filed) 



I hereby declare mat I have reviewed and understand the contents of the above- identified specification, including 
the claims, as amended, by any amendment referred to above. 

I acknowledge the duty to disclose to the United States Patent and Trademark Office all information known to 
me which is material to patentability in accordance with Title 37, Code of Federal Regulations, §1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, §119 of any foreign application (s) 
for patent or inventor's certificate listed below and have also identified below any foreign application(s) for patent or 
inventor's certificate or any PCT international application(s) designating at least one country other than the United States 
of America filed by me on the same subject matter having a filing date earlier than that of the application(s) on which 
priority is claimed. 



Prior (Foreign) Application^ any Priority Claims Under 35 U.S.C. 119 



Priority Claimed 



(Country) 



(Number) 



(Country) 



(Number) 



(Day/Month/Year Filed) 



(Day/Monih/Year Filed) 



□ 

Yes 

□ 

Yes 



□ 

No 

□ 

No 



Priority Claims from U.S. Provisional Application^ - I hereby claim the benefit under Title 35, United States Code, 
§ 1 1 9(e) of any United States provisional application(s) listed below: 



Application No. 



Day/Month/Year Filed 



Application No. 



Day/Month/Year Filed 



Do not use thii 

portion to 
Identify a PCT 
application if 

the parent 
application is 

the U.S. 
Nntiooal phase 
Of the PCT 
application 



I hereby claim the benefit under Title 35, United States Code, 120 of any United States 
appiication(s) or PCT international application(s) designating the United States of America that is/are 
listed below and, insofar as the subject matter of each of the claims of this application is not disclosed in 
thatfthose prior applications ) in the manner provided by the first paragraph of Title 35, United States 
Code §1 12, 1 acknowledge the duty to disclose to the United States Patent and Trademark Office all 
information known to me to be material to patentability as defined in Title 37, Code of Federal 
Regulations, §1.56 which became available between filing date of the prior application and the national 
or PCT international filing date of this application. 

13 



(U.S. Application Number) (U.S. Filing Date) Status (patented, pending, abandoned) 



I hereby appoint the following attorneys of the firm of Stevens, Davis, Miller & Mosher, L.L.P. as my 
attorneys of record with full power of substitution and revocation to prosecute this application and to transact all 
business in the Patent and Trademark Office: 

James E. Ledbetter, Reg. No. 28732; Thomas P. Pavelko, Reg. No. 3 1689; and Anthony P. Venturino Reg 
No. 31674. 

AIX CORRESPONDENCE IN CONNECTION WITH THIS APPLICATION SHOULD BE SENT TO 
STEVENS, DAVIS, MILLER & MOSHER, L.L.P., 1615 L Street, N.W., Suite 850, Washington, D.C. 20036, 
TELEPHONE (202) 408-5100, FACSIMILE (202) 408-5200, 



See page 2 for signature lines 



c 1998 Stevens, Davis. Miller £l Mcaber, LJUP 



See ccfacr ade far instruct jc»K Sbr i ■ mm[1* liiif, 



facm 



STEVENS, DAVIS, MILLER & MOSHER, L-L.P. 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and belief are believe 
to be true; an<f further that these statements were made with the knowledge that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code, and that such willful statements may jeopardize the validity of the 
application or any patent issuing thereon. 



14a 

15a 

16a 

17a 

18a 
19a 

1 4b 



Typewritten Full Name 
of Sole or First Inventor 



Inventor's Signature 
Date of Signature 

Residence 



Citizenship 

Post Office Address 
(Insert complete mailing 



PAGE 2 OF U.S.A. DECLARATION FORM 

Fang-Chu 



Given Name 



Middle Name 



CHEN 



Family Name 



Month 



/ 



Day 



Year 



Taipei 



City 

Taiwan. Republic of China 



State or Province 



Taiwan. Republic of China 



Country 



4F, No. 6» Lan 182. Ning-Po West Street 



address, including country) Taipei, Taiwan. Republic of China 

Typewritten Full Name 
of Sole or Second Inventor 



Given Name 



Middle Name 



Family Name 



15b 



Inventor's Signature 



1 DD 


Date of Signature 
















Month 


Day 


Vpar 

i car 


17b 


Residence 














City 




State or Provtnce 


— _ — 

Oountry 


18b 


Citizenship 










19b 


^ Post Office Address 












(Insert complete mailing 
J address, including country) 










14c 


\ :J Typewritten Full Name 
of Sole or Third Inventor 
















Given Name 


Middle Name 


Family Name 


15c 


. /'Inventor's Signature 










16c 


r Date of Signature 
















Month 


Day 


Year 


17c 


"Residence 














City 




State or Province 


Country 


18c 


Citizenship 










19c 


Post Office Address 












(Insert complete mailing 
address, including countrv) 










14d 


Typewritten Full Name 
of Sole or Fourth Inventor 
















Given Name 


Middle Name 


Family Name 


15d 


Inventors Signature 










16d 


Date of Signature 


isr 














Month 


Day 


Year 


17d 


Residence 














City 




State or Province 


Country 


18d 


Citizenship 










19d 


Post Office Address 












(Insert complete mealing, 
address, tnchuBng country) 










•Note to Inventon Please sign name on line 1 5 exactly as it appears i 
idertiScatiaa and signatures for tbe additional urvtsdnra. 


ii Tine 14 and insert the act 


ml date of signing on line 16. If there are m< 


xe than four inventor, please add a copy of this page fa* 



1^9* STEVENS. DAVIS, MELUER & MOSHER, LJ__P 



INSTRUCTIONS FOR COMPLETION OF THIS FORM 



line \ insert thesame titte as is used on the specification and in the assignment. 

line 2 Is optional but is provided so that you can use it to identify more readily an application prior to the time that the Patent Office application 

serial number is assigned. We suggest mat the specification, drawings and declaration always bear a file number since it can help to get the 
papers together in case they become inadvertently separated. In instances where the specification is filed without a signed declaration form 
(under 37 CFR §1.53) a file number on a later-received separate form will assist us in associating it with the correct case. 

line 3 Check this box if the specification, claims and drawing (if any) are attached to this declaration form, e.g., when filing a new patent 

application. 

lines 4-5 Are only used in an instance where the application is already on file and the declaration from is being separately filed, e.g.,when the 
application was originally filed without a signed declaration or where the Patent Office has required a new declaration because of a deficiency 
in the original declaration. In such an instance the Patent Office will require that lines 4 and 5 be completed with the filing date and 
application serial number already assigned. 

line 6 Is used in conjunction with line 5 but only when there have been one or more amendments to the specification or claims. Line 6 is also use 

when the Examiner requires a new declaration because claims inserted by amendment cover subject matter not originally claimed (37 CFR 
§1.67). 

lines 7-11 Are for PCT (Patent Cooperation Treaty) cases and are used only when you are entering the U.S. National phase (Chapter I or II) based upo 
a previously filed PCT International application designating the U.S. 

line 7 Check this box if this is a PCT National Phase application. 

line 8 Insert PCT International application number. 

line 9 Insert date of filing of PCT International application. 

lines 10-1 1 Insert the date of all amendments filed in the PCT International application. Such amendments are optional, so this line at times will not 
be used. 

line 12a Is used in the following instances: 

(i) If a single priority is being claimed from a foreign application you need to list only the first-filed application; you do not need to list 
other countries if all applications were filed within one year of the U.S. filing. 
.. .] (ii) If multiple priorities arc being claimed, from a plurality of applications filed in one or more countries, you must list the first filed 
-, j. application for each aspect of the invention. Example: if aspect A of the invention was disclosed in an application filed 1 1 months 

: ^ earlier in country X and aspect B was disclosed 9 months earlier in an application filed in country Y, then the applications in both 

countries X and Y must be identified. Only the first application for each aspect of the invention needs to be identified provided all 
applications on that aspect were filed within one year prior to the U.S. filing. 
(Hi) If a non-priority application is being filed you must list all applications in all countries where corresponding foreign applications were 
filed more than one year prior to the U.S. filing. This is so the Examiner can check to see if any of those applications were published 
or patented early enough to be prior art against the U.S. application, 
(iv) If there are more than two applications to be listed we suggest that you type in on this form only "See attached Schedule A" and then 
r . i list all of the previous applications on an attached sheet. 

line 1 2b Is used to claim priority under 35 USC § 11 9(e) based on a provisional application filed within one year of the filing of the instant application 
■r More than one provisional application may be identified provided neither was filed more than one year earlier. 

line 1 3^! This block is used only in instances where there is a previously filed U.S. non-provisional application which was copending at the time th 
present application was (or is being) filed, that previous application could be a U.S. non-provisional application or the National Phase of 
a PCT allocation. In such a case the present application may be entitled to the priority of the previous application's U.S. filing date (and 
consequently the foreign priority thereof) provided the present application is identified as a continuing application (continuation, divisional 
... or continuation-in-part) of the earlier (parent) application. If the foregoing is applicable, please fill in one line for each such prior application. 

line 14^ Type the inventor's proper legal name in the order specified, e.g., "John B. JONES" or "J. Bob JONES" if the inventor so prefers. It is no_ 
acceptable to use only initials such as "J. B. JONES/' 

line 15 The inventor's " signature" may be his (or her) usual manner of signing but it is preferable that the inventor simply write his (or her) name 

in his (or her) own cursive handwriting in the same order as on line 14, e.g., given name, middle initial and Family name. 

line 16 Insert the actual date of signature. 

line 17 Insert simply the city and state or country, e.g., "Paris, France", of the inventor's residence, not citizenship. No street address or postal cod 

is required on this line. 

line 1 8 Insert the inventor's citizenship. The statement of citizenship (or subject of) is a statutory requirement (35 USC § 1 15). Simply the name 

of the country of citizenship, e.g., "Japan" is sufficient. 

line 19 Insert the inventor's mailing address. The purpose of requiring the post office address is to enable the Patent Office to communicate directl 

with the inventor if desired, such as in the case of death of the U.S. attorney. It should be the address where the inventor customarily receives 
his (or her) mail and should include the postal code. If applicable it can be the inventor* s business address or address at place of employment. 

Applicants are reminded that the U.S. Patent and Trademark Office has very strict requirements as to proper execution of an application. The 
applicant should make sure that he reviews the declaration, prior to signing to make sure the declaration properly identifies the application and all relevant 
information; and should review the specification and claims (including drawings, if any) before signing the declaration. Failure to do so will require the 
ffling of a supplemental declaration — 37 CFR § 1.67(c). 

Any handwritten changes to the specification, claims or drawings must be in ink personally by all of the inventors prior to signing the declaration 
and tbe adjacent left margin must be initialed and dated by all of the inventors, e.g., "JBJ 6-9-91". 

Please let «s know if there are any questions regarding proper completion of this form. Thank you. 

An assignment, a separate document requiring separate signature and dating may be enclosed. Please look for it and sign and Hatp it in the sam 
manner as in lines 1 5 and 16 above. 



